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COMPUTERIZED ADAPTIVE IMAGING 



FIELD OF THE INVENTION 
The present invention relatPc t„ • 
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independent PSF is well known and is described in the following publications, some of 
them authored by some of the present inventors; Jansson, P. A. ed. "Deconvolution of 
images and spectra". Academic Press NY (1997); Agard, D.A. and Sedat, J.W. 
"Three-dimensional architecture of a polytene nucleus". Nature 302:676-681 (1984); 
Agard, D.A., Hiraoka, Y., Shaw, P. and Sedat, J.W. "Fluorescence microscopy in three 
dimensions". Methods in Cell Biology 30: 353-377 (1989), Castleman, K.R. "Digital 
Image Processing". Prentice-Hall Inc. Englewood Cliffs, New Jersey (1979). Correction 
of telescopic images by the use of suitably distorted mirrors and deconvolution of two 
dimensional telescope images having location dependent PSF are described in the 
following publications: Boden, A.F., Reeding, D.C, Hanisch, R.J., Mo, J. and White, R. 
"Comparative results with massively parallel spatially-variant maximum likelihood image 
restoration". Bui Am Astr. Soc 27:924-929 (1995), Boden, A.F., Reeding, DC, 
Hanisch, R.J. and Mo, J. "Massively parallel spatially-variant maximum likelihood 
restoration of Hubble space telescope imagery". J Opt Soc Am A 13: 1537-1545 (1996), 
Jansson, P. A. ed. "Deconvolution of images and spectra". Academic Press NY (1997), 
Tyson R.K. "Principles of Adaptive Optics" Academic Press NY (1991). Reconstruction 
of blurred images from point objects is described in the following publications: 
Carrington, W.A., Lynch, R.M., Moore, D.W., Isenberg, G., Fogarty, K.E. and Fay, F.S. 
"Superresolution three-dimensional images of fluorescence in cells with minimal light 
exposure". Science 268:1483-1487 (1995); Femino, A.M., Fay, F.S , Fogarty, K., and 
Singer, R.H. "Visualization of single RNA transcripts in situ". Science 280:585-590 
(1998). 

SUMMARY OF THE INVENTION 
The present invention seeks to provide improved apparatus and 
techniques for post acquisition image processing. 

There is thus provided in accordance with a preferred embodiment '^^^ 

.lii'U'^^N-^':.!' v.),^:h. .i i a\ iracci. uuiizinu tne miormation relatmg to the 
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refractive characteristics to trace a multiplicity of rays from a multiplicity of locations in 
the three-dimensional imaged volume through the three-dimensional imaged volume, 
thereby providing a location dependent point spread function and a deconvolver, utilizing 
the location dependent point spread function, to provide an output image corrected for 
distortions due to variations in the refractive characteristics in the three-dimensional 
imaged volume. 

Preferably, the image information acquirer acquires at least two 
three-dimensional images of a three-dimensional imaged volume, at least une of the two 
three-dimensional images containing the information relating to the refractive 
characteristics in a three-dimensional imaged volume. 

When the refractive characteristics are extractable from the image to be 
corrected for distortions, or are known independently, only one three-dimensional image 
need be acquired. 

The acquirer may obtain refractive index information from DIC, for 
example from phase microscopy or from fluorescence -for example in DNA associated 
stains wherein the stain intensity is proportional to the refractive index increment. 

Refractive index mapping may be applied to samples whose refractive 
index is known. For example this may apply to microchip wafer structures, whose 
geometry is known. 

In accordance with a preferred embodiment of the present invention, the 
image acquirer acquires at least three three-dimensional images of the three-dimensional 
imaged volume. 

Preferably, the image acquirer acquires a plurality of three-dimensional 
images of the three-dimensional imaged volume, each the image having a discrete 
wavelength band. 

Alternatively, the image acquirer acquires a multiplicity of 
three-dimensional images of the three-dimensional imaged volume, each the imaue 

V j^uciciie^: ci:itH)airnen: ol the present irA entioi;. the 
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ray tracer and the deconvolver utilize the information relating to the refractive 
characteristics in a three-dimensional imaged volume obtained from one of the 
three-dimensional images to correct at least another one of the three-dimensional image 
or itself 

The acquirer may obtain refractive index information from DIC, or from 
phase microscopy or from fluorescence -for example in DNA associated stains wherein 
the stain intensity is proportional to the refractive index increment. 

Refractive index mapping may be applied to samples whose refractive 
index is known. For example this may apply to microchip wafer structures, whose 
geometry is known. 

According to one embodiment of the present invention, the 
three-dimensional images are electromagnetic energy images. Preferably, the 
three-dimensional images are infrared images. 

Alternatively, the three-dimensional images are non-electromagnetic 

images. 

In accordance with a preferred embodiment of the present invention, the 
image acquirer receives digital image data from a digital image source and derives 
therefrom the information relating to the refractive characteristics in a three-dimensional 
imaged volume. 

Preferably, the ray tracer and the deconvolver operate repeatedly over 
time to provide a multiplicity of output images, each corrected for distortions due to 
variations in the refractive characteristics in the three-dimensional imaged volume. Such 
a deconvolution process can be iteratively applied to the whole process to improve the 
estimation of the refractive index. 

In accordance with one embodiment of the present invention, the output 
image is an acoustic image and the refractive characteristics are characteristics of a 
material which the passage of acoustic energy therethrough. 

- ;.[■. ^:cw\\s::^- ^ ' . .m.;.i. uabsdge v^: elect! oinagnctic energy therethrough 
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There is also provided in accordance with a preferred embodiment of the 
present invention a method for computational adaptive imaging including the steps of: 

providing information relating to the refractive characteristics in a 
three-dimensional imaged volume; 

ray tracing, utilizing the information relating to the refractive 
characteristics, a multiplicity of rays from a multiplicity of locations in the 
three-dimensional imaged volume through the three-dimensional imaged volume, thereby 
providing a location dependent point spread function; and 

deconvolving, utilizing the location dependent point spread frmction, 
thereby providing an output image corrected for distortions due to variations in the 
refractive characteristics in the three-dimensional imaged volume. Such a deconvolution 
process can be iteratively applied to the whole process to improve the estimation of the 
refractive index. 

Preferably, the step of providing information includes acquiring at least 
two three-dimensional images of a three-dimensional imaged volume, at least one of the 
two three-dimensional images containing the information relating to the refractive 
characteristics in a three-dimensional imaged volume. 

When the refractive characteristics are e?ctractable from the image to be 
corrected for distortions, or are known independently, only one three-dimensional image 
need be acquired. 

In accordance with a preferred embodiment of the present invention, the 
step of providing information includes acquiring at least three three-dimensional images 
of a three-dimensional imaged volume. 

Preferably, the step of providing information includes acquiring a plurality 
of three-dimensional images of the three-dimensional imaged volume, each image having 
a discrete wavelength band. 

In accordance with a preferred embodiment of the present invention, the 

step of prn\'i fiit^ ,t 
i; ■■■■Miv:. : -'wwai.... . ; cpi tj^eiiici o\ inc wavelength bands of the 
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multiplicity of three-dimensional images. 

In accordance with one embodiment of the present invention, the 
three-dimensional images are electromagnetic energy images. Preferably, the 
three-dimensional images are infrared images. 

In accordance with an alternative embodiment of the present invention, 
the three-dimensional images are non-electromagnetic images. 

The refractive index may be in any medium and the imaging method may 
be for a generalised melliud for inhomogeneous media that may distort the image. 

Preferably, the step of providing includes receiving digital image data 
from a digital image source and deriving therefrom the information relating to the 
refractive characteristics along a multiplicity of light paths in a three-dimensional imaged 
volume. 

In accordance with a preferred embodiment of the present invention, the 
steps of providing information, ray tracing and deconvoluting operate repeatedly over 
time to provide a multiplicity of output images, each corrected for distortions due to 
variations in the refractive characteristics in the three-dimensional imaged volume. Such 
a deconvolution process may be iteratively appUed to the whole process to improve the 
estimation for the refractive index map. 

There is also provided in accordance with a preferred embodiment of the 
present invention apparatus for utilizing differential interference contrast images to 
provide three-dimensional refractive index information including a line integrator 
operating on differential interference contrast images displaying a directional derivative 
of refractive index of an object to invert the directional derivative thereof, thereby 
providing a plurality of two-dimensional representations of the refractive index of the 
object. Alternatively the three-dimensional refractive index map can be obtained from 
phase microscopy, or from fluorescence where the staining is proportional to the 
refractive index increment 

provide three-dimensional refracti\e index information and also mcludmg a decon\olver 
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performing deconvolution of the plurality of two-dimensional representations of the 
refractive index of the object, thereby reducing out-of-focus contributions to the 
two-dimensional representations of the refractive index of the object. 

There is fijrther provided in accordance with a preferred embodiment of 
the present invention a method for utilizing differential interference contrast images to 
provide three-dimensional refractive index information including performing line 
integration on differential interference contrast images displaying a directional derivative 
of refractive index of an object to invert ilie directional derivative thereof, thereby 
providing a plurality of two-dimensional representations of the refractive index of the 
object. Alternatively the three-dimensional refractive index map can be obtained from 
phase microscopy, or from fluorescence where the staining is proportional to the 
refractive index increment. 

Additionally in accordance with a preferred embodiment of the present 
invention there is provided a method for utilizing differential interference contrast images 
to provide three-dimensional refractive index information and also including performing 
deconvolution of the plurality of two-dimensional representations of the refractive index 
of the object, thereby reducing out-of-focus contributions to the two-dimensional 
representations of the refractive index of the object. Again, the three-dimensional 
refractive index map can be obtained from phase microscopy, or from fluorescence 
where the staining is proportional to the refractive index increment. 

Further in accordance with a preferred embodiment of the present 
invention there is provided apparatus for ray tracing through a medium having multiple 
variations in refractive index including: 

a computer employing an analytically determined path of a ray through 
the muhiplicity of locations in the medium, for a plurality of rays impinging thereon in 
different directions, by utilizing known local variation of the refractive index at a 
muhiplicity of locations in the medium 



uiin';.:. i'jiidciAc inuc,\ mciuamg 
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determining local variation of the refractive index at a multiplicity of 
locations in the medium, 

analytically determining the path of a ray through the multiplicity of 
locations in the medium, for a plurality of rays impinging thereon in different directions. 
The ray tracing may also include the computation of absorptions, reflections and 
scattering of rays and their contributions to the imaging process. 

Still further in accordance with a preferred embodiment of the present 
invention there is provided apparatus for confocal microscopy including; 

a ray tracer, employing known variations of the refractive index in a 
three-dimensional sample for determining the paths of a multiplicity of rays emerging 
from at least one point in the sample and passing through the sample, thereby 
determining an aberrated wavefront for each the point; and 

an adaptive optics controller utilizing the aberrated wavefront to control 
an adaptive optical element in a confocal microscope, thereby to correct aberrations 
resulting from the variations in the refractive index. 

There is additionally provided in accordance with a preferred embodiment 
of the present invention a method for confocal microscopy including: 

determining variations of the refi^active index in a three-dimensional 

sample, 

determining the paths of a multiplicity of rays emerging fi^om at least one 
point in the sample and passing through the sample, thereby determining an aberrated 
wavefront for each the point, and 

utilizing the aberrated wavefront to control an adaptive optical element in 
a confocal microscope, thereby to correct aberration resulting from the variations in the 
refractive index. 

There is additionally provided in accordance with a preferred embodiment 
of the present invention a method for adding (computationally or physically) in the 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention will be understood and appreciated more fully from 

the following detailed description, taken in conjunction with the drawings in which: 

Figs. lA and IB are respectively representations of three dimensional 

microscopic images of an object according to the prior art and in accordance with the 

present invention; 

Fig. 2 is a simplified partially pictorial, partially block diagram illustration 
of apparatus for computational adaptive imaging constructed and operative in 
accordance with a preferred embodiment of the present invention; 

Fig. 3 is a simplified flow chart of the operation of the apparatus for 
computational adaptive imaging of Fig, 2; 

Fig. 4 is a simplified diagram of line integration functionality which is 
carried out by the apparatus of Fig. 2; 

Fig. 5 is a simplified diagram of ray tracing fijnctionality which is carried 
out by the apparatus of Fig. 2; 

Fig. 6 is a simplified diagram of wavefront integration functionality which 
is carried out by the apparatus of Fig. 2, and 

Fig. 7 is a simplified flow chart illustrating deconvolution functionality 
which is carried out by the apparatus of Fig. 2. 

DETAILED DESCRIPTION OF THE INVENTION 
Reference is now made to Figs. lA and IB, which are respectively 

representations of three dimensional microscopic images of an object according to the 

prior art and in accordance with the present invention. 

It is known in the prior art to image a point source or a collection of point 

sources in an ideal sample displaying no substantial variation in refractive index. When an 

ideal optical system is focussed at slightly different depths in the sample, a three 

dimensional imae^e appear^ ^^^r^Hjnf^ n ^i...,r,* 
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deconvoluting the plurality of two-dimensional images 1 - V to a deconvoluted three 
dimensional image, including a single in focus two-dimensional image V'l, which contains 
substantially all of the image intensity from images I - V and a plurality of out of focus 
two-dimensional images which substantially contain no image intensity. 

The prior art, however, does not know how to deal adequately with 
samples which display substantial variation in refractive index. 

The present invention provides a solution to this problem, as illustrated in 
Fig. IB which shows images of a non-ideal sample, such as a biological sample, 
displaying substantial variation in refractive index. When an ideal optical system is 
focussed at slightly different depths in the non-ideal sample, a three-dimensional image 
appears, including a plurality of two-dimensional diffraction limited images designated by 
Roman numerals 1, II, III, IV and V in Fig. IB. In contrast to the images appearing in 
Fig. lA, it is seen that these images are extremely non-uniformly distorted due to 
variations in the refractive index at various locations in the sample. 

The present invention, as will be described hereinbelow, is capable of 
deconvoluting the plurality of two-dimensional im.ages I - Y in Fig. IB, notwithstanding 
their great distortions due to variations in the refractive index at various locations in the 
sample, to a substantially non-distorted, deconvoluted three-dimensional image, 
including a single in-focus two-dimensional image VI, which contains substantially all of 
the image intensity from images 1 - V and a plurality of out-of- focus two-dimensional 
images which substantially contain no image intensity. 

Reference is now made to Fig. 2, which is a simplified partially pictorial, 
partially block diagram illustration of apparatus for computational adaptive imaging 
constructed and operative in accordance with a preferred embodiment of the present 
invention The apparatus of Fig 2 typically includes a conventional computer-controlled 
optical microscope 10, such as a microscope manufactured by Carl Zeiss and sold under 
the name Axioskop Associated with microscope 10 there are preferably provided 
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mirror 20 within the microscope 10 

Trans-illumination is provided to a sample 22, typically mounted between 
two slides 24 and 26, by means of a halogen light source 28 via a computer-controlled 
shutter 30. Depending on which of shutters 18 and 30 is open, the sample receives 
trans-illumination or epi-illumination so as to provide either a DIC image or a fluorescent 
image respectively. It is noted that DIC images conventionally require additional optical 
elements in the imaging light path, which are omitted from Fig. 2 for the sake of 
conciseness and claritv. 

In accordance with a preferred embodiment of the present invention, the 
DIC or fluorescent image is received via computer-controlled filter wheel 14 by a digital 
CCD sensor 32, such as a Photometries PXL. Preferably a polarizer is included in one of 
the windows of filter wheel 14 and is employed for DIC imaging. 

In accordance with a preferred embodiment of the present invention, the 
output of the digital CCD sensor 32 is supplied to a computer 34, such as a Silicon 
Graphics 02 workstation which performs the following functionality: 

ray tracing, utilizing information relating to the refractive characteristics 
in the sample, a muUiplicity of rays from a multiplicity of locations in the sample through 
the sample, thereby providing a location dependent point spread function; and 

deconvoluting, utilizing the location dependent point spread function, 
thereby providing an output image corrected for distortions due to variations in the 
refractive characteristics in the three-dimensional imaged volume. 

Preferably wavefront integration is performed following the ray tracing 
and prior to the deconvoluting. 

In accordance with a preferred embodiment of the present invention, the 
information relating to the refractive characteristics of the sample is provided by line 
integration of the DIC image. 

Reference is made to Fig 3, which is a simplified flow chart of the 

. ; ^H'^ci\c^ iiui;r escerit ^-^i) iriiaues ana a ditlerential iiuerfcrence contrast 
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(DIC) 3D image 42. 

In accordance with a preferred embodiment of the present invention, line 
integration 44 is performed on the DIC. The line integration preferably provides a 3D 
refractive index map 46. 

In accordance with a preferred embodiment of the present invention, ray 
tracing 48 is performed on the 3D refractive index map 46 and the resulting wavefront is 
subject to wavefront integration 50, thus providing a location dependent point spread 
function (?SF) 52. 

In accordance with a preferred embodiment of the present invention, the 
location dependent PSF is utilized in a deconvolution step 54 which is applied to the 
observed fluorescent 3D image 40. 

In accordance a preferred embodiment of the invention, the deconvolution 
produces a corrected image, such as the image illustrated at reference VI in Fig. IB. 

Reference is now made to Fig. 4, which is a simplified diagram of line 
integration functionality which is carried out by the apparatus of Fig. 2. Fig. 4 illustrates 
a sample, such as a sphere 60 of uniform index of refraction, which differs from that of 
surrounding media 62. Sample 60 may be taken to represent a nucleus, while the 
surrounding media may be taken to represent cytoplasm. A scan line 64 illustrates the 
index of refraction as a function of location along line 65. The characteristic PSF of the 
microscope 10 operating in the DIC imaging mode is illustrated at reference numeral 66 
The PSF is also illustrated by trace 68. 

The output image of sample 60 of the CCD sensor 32 operating in a DIC 
mode is illustrated at reference numeral 70 and also by trace 72. Line integration of the 
output image produces an image 74 which accurately represents the original sample, seen 
at reference numerals 60 and 62. 

It is appreciated that line integration of DIC images has two complex 
contributions in reality. One is the accumulation of noise in the integration and the 

■ ;x ^ ^J:-^'l-^vu:> ^v)ntiinut:un ca:; reduces signitlcantly b\ deconvolutmg the 
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integrated DlC images. 

Reference is now made to Fig. 5, which is a simplified diagram of ray 
tracing functionality which is carried out by the apparatus of Fig. 2. As seen in Fig. 5, it 
is seen that an isotropic fan of rays is drawn from every point in an imaged volume, e.g. 
the sample. These rays are ray traced such that their paths and phases are modified in 
accordance with variations in the refractive index of the sample. The resuh of the ray 
tracing is an aberrated wavefront for every point in the imaged volume. 

Reference is now made to Fig. 6, which is a simplified diagram of prior 
art wavefront integration fijnctionality which is carried out by the apparatus of Fig. 2. As 
seen in Fig. 6, for every point in the vicinity of a focus RO, an interference integral is 
taken over the wavefront. The integrations for all of the points in the vicinity of the focus 
RO define the three-dimensional point spread Sanction, as described inter alia in the 
aforesaid prior art reference to Goodman. 

Reference is now made to Fig. 7, which is a simplified flow chart 
illustrating deconvolution fijnctionality which is carried out by the apparatus of Fig. 2. As 
seen in Fig. 7, the observed image 80, such as the observed fluorescent 3D image 40 
(Fig. 3) is deconvoluted using the point spread fijnction (PSF) calculated as described 
hereinabove with reference to Figs. 5 and 6. It is appreciated that the location dependent 
PSF is preferably a multi-resolution PSF. This calculation is preferably performed in an 
iterative process which endeavors to provide progressively better approximations of the 
imaged sample. 

This iterative process typically proceeds by initially defining a guessed 
object 82, which typically is identical to the observed image. The guessed object is 
convoluted with a location dependent point spread function 84, such as that derived by 
ray tracing and wavefront integration (Fig. 3) to produce a blurred image 86. This 
blurred image is compared with the observed image and a correction based on the 
comparison is iterativeiy applied to the guessed object. Following multiple iterations, the 

v.ivUtuMui. iecnn;Ccii cicscripiionb o: a preitTrec embodmicnt of the 
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invention appear in the following article by the inventor Z. Kam: "Microscopic 
Differential Interference Contrast Image Processing by Line Integration (LID) and 
Decon volution". Bioimaging 6 (4): 166-176 (1998). 

It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described hereinabove. 
Rather the scope of the present invention includes both combinations and 
subcombinations of the various features described hereinabove as well as modifications 
and additions thereto which would occur to a person of skill in the art upon reading the 
foregoing description and which are not in the prior art 
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CLAIMS 

We claim: 

1. Apparatus for computational adaptive imaging including; 

an image information acquirer providing information relating to the 
refractive characteristics in a three-dimensional imaged volume, 

a ray tracer, utilizing the information relating to the refractive 
characteristics to trace a multiplicity of rays from a multiphcity of locations in the 
three-dimensional imaged volume through the three-dimensional imaged volume, theieby 
providing a location dependent point spread fijnction; and 

a deconvolver, utilizing the location dependent point spread function, to 
provide an output image corrected for distortions due to variations in the refractive 
characteristics in the three-dimensional imaged volume. 

2. Apparatus according to claim 1 wherein the acquirer is adapted to obtain 
refi*active index information from DIG, for example from phase microscopy or from 
fluorescence. 

3. Apparatus according to claim l wherein the acquirer is adapted to utilize 
previously determined refractive characteristics. 

4. Apparatus for computational adaptive imaging according to claim 1 and 
wherein the image information acquirer acquires at least two three-dimensional images of 
a three-dimensional imaged volume, at least one of the two three-dimensional images 
containing the information relating to the refractive characteristics in a three-dimensional 
imaged volume. 

5. Apparatus according to claim 4 and wherein the image acquirer acquires 
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plurality of three-dimensional images of the three-dimensional imaged volume, each the 
image having a discrete wavelength band. 

7. Apparatus according to claim 4 and wherein the image acquirer acquires a 
muhiplicity of three-dimensional images of the three-dimensional imaged volume, each 
the image having a wavelength band which is part of a continuum represented by the 
wavelength bands of the multiplicity of three-dimensional images. 

8. Apparatus according to claim 4 wherein the image acquirer acquires a 
single three-dimensional image of the three-dimensional image volume. 

9. Apparatus according to claim 4 and wherein the ray tracer and the 
deconvolver utilize the information relating to the refractive characteristics in a 
three-dimensional imaged volume obtained from one of the three-dimensional images to 
correct at least another one of the three-dimensional images. 

10. Apparatus according to claim 9 wherein the ray tracer includes effects on 
the image of absorptions, reflections and scattering in the sample 

11. Apparatus according to claim l, and wherein the three-dimensional 
images are electromagnetic energy images. 

12. Apparatus according to claim 11 and wherein the three-dimensional 
images are infrared images. 

13. Apparatus according to claim 1, and wherein the three-dimensional 
images are non-electromagnetic images. 

...uiKii .;:..iuL c.;:<i iu)iri a aimid: iniaue source anJ aerue^ tneretrom the information 
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relating to the refractive charactenstics in a three-dimensional imaged volume. 

15. Apparatus according to claim 1, and wherein the image acquirer, the ray 
tracer and the deconvolver operate repeatedly over time to provide a multiplicity of 
output images, each corrected for distortions due to variations in the refractive 
characteristics in the three-dimensional imaged volume. 

16. .Apparatus according to clalni i, and wherein the output image is an 
acoustic image and the refractive characteristics are characteristics of a material which 
the passage of acoustic energy therethrough. 

17. Apparatus according to claim 1, and wherein the output image is an 
electromagnetic image and the refractive characteristics are characteristics of a material 
which the passage of electromagnetic energy therethrough. 

18. A method for computational adaptive imaging including the steps of: 

providing information relating to the refractive characteristics in a 

three-dimensional imaged volume; 

ray tracing, utilizing the information relating to the refractive 
characteristics, a multiplicity of rays from a multiplicity of locations in the 
three-dimensional imaged volume through the three-dimensional imaged volume, thereby 
providing a location dependent point spread function, and 

deconvoluting, utilizing the location dependent point spread function, 
thereby providing an output image corrected for distortions due to variations in the 
refractive characteristics in the three-dimensional imaged volume. 



19 



A method according to claim 18, for addine in the imaeine path ?.. 
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20. A method for computational adaptive imaging according to claim 18 and 
wherein the step of providing information includes acquiring at least two 
three-dimensional images of a three-dimensional imaged volume, at least one of the two 
three-dimensional images containing the information relating to the refractive 
characteristics in a three-dimensional imaged volume. 

21. A method according to claim 20 and wherein the step of providing 
information includes acquiring at least thice three-dimensional images of a 
three-dimensional imaged volume. 

22. A method according to claim 20 and wherein the step of providing 
information includes acquiring a plurality of three-dimensional images of the 
three-dimensional imaged volume, each the image having a discrete wavelength band. 

23. A method according to claim 20 and wherein the step of providing 
information includes acquiring a multiplicity of three-dimensional images of the 
three-dimensional imaged volume, each the image having a wavelength band which is 
part of a continuum represented by the wavelength bands of the multiplicity of 
three-dimensional images. 



24. A method according to claim 18, and wherein the three-dimensional 
images are electromagnetic energy images. 

25. A method according to claim 24 and wherein the three-dimensional 
images are infrared images. 

26. A method according to claim 18, and wherein the three-dimensional 



.-A nietnuu accoromu to claim is, ana v\ herein the step of providmii 
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includes receiving digital image data from a digital image source and deriving therefrom 
the information relating to the refractive characteristics along a multiplicity of light paths 
in a three-dimensional imaged volume. 

28. A method according to claim 18, and wherein the steps of providing 
information, ray tracing and deconvoluting operate repeatedly over time to provide a 
multiplicity of output images, each corrected for distortions due to variations in the 
refractive characteristics in the three-dimensional imaged volume. 

29. A method according to claim 28 wherein the refractive characteristics are 
estimated. 

30. Apparatus for utilizing differential interference contrast images to provide 
three-dimensional refractive index information including a line integrator operating on 
differential interference contrast images displaying a directional derivative of refractive 
index of an object to invert the directional derivative thereof, thereby providing a 
plurality of two-dimensional representations of the refractive index of the object. 

31. Apparatus for utilizing differential interference contrast images to provide 
three-dimensional refractive index information according to claim 30 and also including a 
deconvolver performing deconvolution of the plurality of two-dimensional 
representations of the refractive index of the object, thereby reducing out-of-focus 
contributions to the two-dimensional representations of the refractive index of the object 

32. A method for utilizing differential interference contrast images to provide 
three-dimensional refractive index information including performing line integration on 
differential interference contrast images displaying a directional derivative of refractive 
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33. A method for utilizing differential interference contrast images to provide 
three-dimensional refractive index information according to claim 32 and also including 
performing deconvolution of the plurality of two-dimensional representations of the 
refractive index of the object, thereby reducing out-of-focus contributions to the 
two-dimensional representations of the refractive index of the object. 

34. Apparatus for ray tracing through a medium having multiple variations in 
refractive index including: 

a computer employing an analytically determined path of a ray through 
the multiplicity of locations in the medium, for a plurality of rays impinging thereon in 
different directions, by utilizing known local variation of the refractive index at a 
multiplicity of locations in the medium. 

35. A method of ray tracing through a medium having multiple variations in 
refractive index including: 

determining local variation of the refractive index at a multiplicity of 
locations in the medium; 

analytically determining the path of a ray through the muhiplicity of 
locations in the medium, for a plurality of rays impinging thereon in different directions. 

36. Apparatus for confocal microscopy including: 

a ray tracer, employing known variations of the refractive index in a 
three-dimensional sample for determining the paths of a multiplicity of rays emerging 
from at least one point in the sample and passing through the sample, thereby 
determining an aberrated wavefront for each the point, and 

an adaptive optics controller utilizing the aberrated wavefront to control 
an adaptive optical element in a confocal microscope, therebv to correct aberration'; 

^ iiitjiii^^C h)\ ^or:lcKa! micruscop\ including 
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determining variations of the refractive index in a three-dimensional 

sample, 

determining the paths of a multiplicity of rays emerging from at least one 
point in the sample and passing through the sample, thereby determining an aberrated 
wavefront for each the point; and 

utilizing the aberrated wavefront to control an adaptive optical element in 
a confocal microscope, thereby to correct aberrations resulting from the variations in the 
refractive index. 
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